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Abstract 

We consider uniform moment convergence of lag-window spectral density esti¬ 
mates for univariate and multivariate stationary processes. Optimal rates of conver¬ 
gence are obtained under mild and easily verifiable conditions. Our theory comple¬ 
ments earlier results which primarily concern weak or in-probability convergence. 


1 Introduction 

Consider the n-dimensional stochastic process: 

Z* = (Z lt ,..., Z it: ..., Z nt )' = R(..., e t _i, e t ), (1) 

where the 5x1 vectors e t are iid and R(.) is a measurable function such that Z t exists (see 
Tong (1990)). Under the above conditions Z t is strictly stationary and ergodic although 
existence of moments is not warranted. Note that we need not impose n > b. In fact, 
we are interested in nonparametric estimation, and thus issues of invertibility and related 
conditions are irrelevant, unlike when considering parametric estimation methods such as 
maximum likelihood. As a consequence of (jT]) 

Zn — Ri{- ■ ■ i U-i; u); i — 1, ■ • •, n, 

for a measurable scalar function Ri(.). In the sequel let T t — (■ ■ •, e t ~ i, e t ). 

In this paper we are interested in studying uniform convergence, in terms of distribution 
as well as in terms of moments, of the kernel estimator of the spectral density matrix: 

fr(A) = T J2 K( )e-“ J C(«), —tt < A < tt, (2) 

u=-T +1 T 
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where % denotes the complex unit and 


1 x* ' 

C(it) = — E z * Z ' t+u where the sum is for all t,t + u between 1 and T, 


T 

Bt is the lag-window size and the kernel function satisfies 


A"(0) = 1, continuous and even, k = / K 2 (u)du < oo. 


The (i, j)-entry of the spectral matrix estimator is denoted by fnj( A) for every 1 < i,j < n. 
Here fy(A) is an estimator of the true spectral density matrix which, when exists, has the 
form 

-j OO 

f(A) = E -I < A < IT, 

u =—oo 

where r(u) = E(Z 0 Z' U ), we Z is the autocovariance matrix satisfying r(—w) = r'(w). 
Hereafter we assume EZ t = 0 with, at minimum, bounded second moment. 

To study asymptotic properties of f T , we will introduce the concept of functional de¬ 
pendence measure. Set 

Z*,{o} = R(. • • e_i, 6 q, ei..., e t ), 

for another iid sequence of b x 1 vector e*, mutually independent from the e t . Define Z it ^ 0 } 
accordingly. Dehne the m-dependent approximating sequence 


Z t — E(Z*| 6t- m , •••,£*) — E(Zt| Tt—m,t ), m > 0, 
with = c(£t-m, ■ ■ ■ i H.) and accordingly. Set the pth norm, for p > 0, equal to: 

n 

ii z t \\ p = (j2 E \ z it n 1/p , ii z t ii=ii z t n 2 . 

Z=1 

For all i = 1 ,,n dehne the functional dependence measure 

&t,p = ll Z it ~ Z it,{ 0} ||p) 


and 


eE = E^ 




t=m 




, p' = min(2,p), 
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Finally, set 


d m,p = Y1 Tmn ^m^ 6 


t,P> 


t =0 


&t,p l mQ J 3Cl<i<n&t,pi O m,p ?7MZ3q<2< n © p, 

Vm, P = maxi<i< n ^^ jP , d m)P = max 1 < i < n d® >p . 

Then 8t, p quantifies of dependence of Z f on eo- Our main results in the paper need condi¬ 
tions on the decay of 5 t)P . 

2 Univariate case 

Throughout this section assume that Z t ,t G Z, is a scalar stochastic process, hence n — 1. 
We also assume that min* /(A) > 0. Let /t(-) be the lag-window estimate (J2J) and define 

0(A) = T[/ t (A) - E/ t (A)]. (3) 

Under suitable conditions on Bt and the process (Z t ), we have the central limit theorem 

^=== =► N(0, nf 2 ( A)), where k = 

For example, Anderson (1971) and Bentkus and Rudzkis (1982) dealt with linear processes 
and Gaussian processes, respectively and Rosenblatt (1984) considered strong mixing pro¬ 
cesses that satisfy 8th order cumulant summability conditions. Here we should consider 
the normalized maximum deviation 


K 2 {u)du. 


(4) 


max |Q(A)|. (5) 

— 7T<A<7T 

The following are needed on conditions on the kernel K and the lag Bt- 
Assumption 1 (Condition 3 of Liu and Wu (2010)). K is an even, bounded function 
with bounded support in [—1,1], lim, t ^ 0 K(u) = A"(0) = 1, k — f \ L K 2 (u)du < 1 and 
E/ e z su P| s -(|<i I K(lw) - K(sw )| = 0(1) asw^r 0. 

Assumption 2 (Condition 4 of Liu and Wu (2010)) There exist 0 < b < b < 1 and ci, c 2 > 0 
such that, for all large T, c\T- < Bt < c 2 T 6 holds. 
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Theorem 1. Let Assumptions 1 and 2 hold. Assume EZo = 0, || Zq || p < oo,p > 4 and 

fim, P = 0(p m ) for some 0 < p < 1. (6) 

Let v* be such that 1 < u* < p/4 — e, some e > 0. Let = ttI/Bt- Then 

\\G\l* > (?) 

where G denotes a Gumbel distributed random variable with cdf e~ e x/2 . 

Remark. Condition (Jh|) can be weakened to 


max 


t |/t(a;) - e[/ t (a;)]| ; 


Bt 


«/ 2 ( a; 


— 2 log Bt + log(7r log Bt) 


d m , P = 0(m ai ), ai > max [1/2 - (p - 4)/(2 5p), 25/p ], 

@m, P = 0(m~ a2 ), a 2 > max [1 - (p - 4)/(2<5p),0] (8) 

where Bt = 0(T b ) for some b < 1 by Assumption 2. Thus, when the assumptions of Theo¬ 
rem [I] hold together with (JHD an d assuming K(.) continuous with K(x) = e~ lXx K(X)d\ 
satisfying /[//. \K(x)\dx < oo, then (J7J) holds. 


Proof. By Theorem 4 and 5 of Liu and Wu (2010) 

t I/t(a;)-e|/t(a;)]| 2 


p 


max 


2 log B t + log(7r log B t ) < x —> e 


_„-x/2 


o<Rb t Bt ^f 2 {^*i) 

under the conditions above. Uniform convergence of the moments of the maximum de¬ 
viations of the spectral density estimates follows once uniform integrability of the v*th 
power of the maximum deviation is established. We now need to prove that for all v with 
1 < v < p/2: 

max |/t(A)—E[/ t (A)]| = 0((B T logB r /T) 1/2 ). (9) 

0<A<7T 

— — V 

However, this is a special case of the (multivariate) Lemma 10 reported below. QED 


3 Multivariate case 

Consider now the case of multidimensional Z t , with n > 1. We first need to derive the 
asymptotic distribution of the maximum deviations of the spectral density matrix estimator 
for f(A). Throughout this section assume that there exists a Cq > 0 such that f(A) — CoI n 
is positive definite for all A. 
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Theorem 2. (Theorem 5 of Liu and Wu (2010)) Let Assumptions 1 and 2 hold. Assume 
EZ 0 = 0, || Z 0 || p < oo,p > 4 and 


$m,p = 0(p m ) for some 0 < p < 1. 


( 10 ) 


Let \] = tt\1\/Bt- Then for all x E M. 


P 


max 
o <i<b t 


T \f Tl ^)-E[f TlJ (\*)]\ 2 


2 log B t + log(7r log Bt) < x ) —> 


for every i,j = 1, n. 


Proof. We generalize the proof of Theorem 5 of Liu and Wu (2010). This requires to 
extent a number of preliminary lemmas, presented in the Appendix. The proof then easily 
follows. QED 

Remark. Theorem [2] holds also under the weaker condition (1S|) . 

Remark. Theorem [2] permits to evaluate simultaneous confidence intervals for any subset 
of elements of maxo<)<B 7 , f(A*) via the Bonferroni method. 

Remark. Without additional difficulties, Theorems 1 and 2 of Liu and Wu (2010) can be 
generalized as follows: 


Theorem 3. (Theorem 1 of Liu and Wu (2010)) Let Condition 1 of Liu and Wu (2010) 
hold. Assume EZ 0 = 0, || Z 0 || p < oo,p > 2 and 0 Op < oo. Let 1 /B T + B t /T —> 0. Then 
for every i,j = 1,.., n 

SU P II frij( A) - fij( A) ||p/2 t 0. 
ag b 

Theorem 4. (Theorem 2 of Liu and Wu (2010)) Let Condition 2 of Liu and Wu (2010) 
hold. Assume Z 0 = 0, || Z 0 || 4 < oo and 0 O ,4 < oo. Let 1 /B T + B t /T —$■ 0. Then for every 
i,j = 1, -,n 

\j{fTij{ A) — E[/tp(A)] j —>d N(0,(j(\)nfii(\)fjj(\)) : 

for any fixed 0 < A < it, where uj(u) = 2 if u/tt G Z and uj{u) = 1 otherwise. The 
asymptotic distribution is complex normal for i j. 
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Remark. Theorem [2] implies 


0 ‘™ I fnj(K) ~ E [fTij(tf)}\ 2 = °p (' Bl X °^ Bl Q max /«(A*)/_,j(A*)^ . 

Remark. If the elements of Z t are mutually independent, the above results hold for p 
replaced by p/2. 

Remark. (Remark 5 of Liu and Wu (2010)) If K(x) — 1 = 0(x) as x —> 0 and ^ fc>1 ^ fc ,2 < 
oo then E/rp(A) — /p(A) = 0(Bf 1 ) and we can replace E/rp(A) by /p(A) for a suffi¬ 
ciently smooth model spectra, in particular whenever TlogT = o(Bf). More in general, 
if E fc >i k q S k>2 < oo, implying that the model spectra is g-differentiable, then E/ Tjj -(A) — 
fij( A) = 0(Bf g ). Note that under (j6]) , it trivially holds that Efc>i k 9 $k ,2 < oo for every 
q > 1. In this case we can replace E/rp(A) by /p(A) for a sufficiently smooth model spec¬ 
tra, in particular whenever TlogT = o(R)? +1 ). Note, however, that q will also depend on 
the choice of the kernel K(.), see Theorem 10, Chapter V, Section 4 in Hannan (1970): 

Inn ;—;-= K a < oo. 

x->0 \x\ q 

As an example, q — oo for the truncated estimator but q = 2 for the Bartlett estimator. 


Remark. We wish to have Bt as small as possible in order to achieve a quasi parametric 
rate but q (smoothness of the spectra) as large as possible, such that 

TlogT = o(T^ +1) ), 


which is satisfied if 


b(q + 1) > 1. 

We now present the multivariate generalization of Theorem |T| 

Theorem 5. Under the assumptions of Theorem [H for all v* such that 1 < v* < p/4 — e, 
some e > 0: 


max 
o <i<b t 

for every i,j 

— C x /‘2 

e e 


T I/t»j(A*) - E[f T ij(X*i 


* M 12 


2 log Bt + log(7T log Bt) 


\\G\l *) ( 11 ) 


Bt «/«(Ar)/ii(Ar) 

= where G denotes a Gumbel distributed random variable with cdf 
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Proof. Convergence of the moments follows by convergence in distribution (Theorem [2]) 
and uniform integrability of the u-tli power of maxo<i<B T |/tp(A*) — E[/rp (A*)]| 2 . This is 
implied by uniform boundedness of the z/th moments, with v* — 2v — e, which follows by 
Lemma [TUI QED 

4 Appendix 

We establish here the lemmas required to proof Theorem 0 

Lemma 1. (Lemma 1 of Liu and Wu (2010)) Assume || Z t || p < oo forp > 1 and EZ t = 0. 
Then Lemma 1 holds for every Z it , i = 1,,n. 

Proof. Trivial since each component of Z t satisfies the assumptions of Lemma 1 of Liu and 
Wu (2010). QED 


Lemma 2. (Proposition 1 of Liu and Wu (2010)) Assume || Z t || 2p < oo forp > 2, EZ t = 0 
and @ 0 , 2 P < oo. Let 


A? ' = ^ ai-i'ZuZji>, A^ — ^ oii-i'ZuZ)i>, 

1 <1<1><T 1 <1<1'<T 

where the at are complex numbers. Then 

|| A [ f j] - E A l f j] - {A [ f j] - E A [ f j] ) 


T~2D t Q 


< C 2p d m < 2 p for every i,j = 1, ..,n, 


Tm 0 ,2p 


setting 


T -1 




a.J 2 ) 2 . 


Proof. Let E it _ x = YaJi a t-iZu, E it -1 = Y.\J\ ®t-iZu and 


S=1 

t -1 


/tfol* _ 

JJl rri - 


^ ^ ai-vZaZj V ^ ^ ZjfEtf 


Then 


ij 1 / J u L l—l , * J il ZJ jl f / 1 * 

1 <1<V<T t =2 


p,(4 i] -4 J> ) ii P <h + ih, 
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setting 


/, = 


Ih = 


I ^ 2 Zjt,{i} (Eit— i En_i) En_ i,{;}) 

1=2 
T 

E II (^?t — Zj t) {i})(E it _i — E it -i) ||p • 


IP’ 


1=2 


Since || E it - E it || 2p < C 2p D T Q ^ + i, 2 p by Lemma 1, and || Z it - Z it:{l} \\ 2p < df_ L2p with 


EL€,2p<0^ J 2p 

E n i ^ c I d t(® 


fiW 


2 n 2 f'I 2 

m+l,2p/ 


E «!£*£*“«■>) < c'l P -D|.T(eE| +li2p ) 2 (eW !> ) 2 


l=—oo 


T—l 

ii E 

i=i 

then 

T 


l=—oo 
T 


l '=1 


^it ^11 -^il,{/} h ^ p Ot-s—tZjs , 


{*} 


s=l+t 


T—l 


T—l 


lp< 2 E™ n (^i,2p’ ^5+l,2p)^2pL>T0o, ] 2 p> 


t=l 


E r > 2 cj p B 2 (e 0 Mp) 2 E ei*E™"(^-*»’*S + ,*)<cl£’ 2 T(e|?i 2 p) 2 eS + i,2,<2p 


2 n 2, rr«h] i 2 ftW 


l=—oo 

Since 0 


t=—oo 


s =1 


< d 


H 


m+l,p — u ' m ?P 

[*j] 


- e 4 j1 - (4 jl * - EA^ 1 *) ||J< ^ || ^(Aj* 1 - A 

l=—oo 

< 2C 2 2 p £> 2 r(9„E) 2 (dM 2 „) 2 < 2 C 2 2 p D 2 Te 2 2p < 2p . 

The same bound applies to || A^* — EA^* — (A^ — EA^) ||^. QED 


i [oh 


[hi _ ^Jbh^ ||2 


Lemma 3. (Proposition 2 of Liu and Wu (2010)) Assume EZ 0 = 0, || Z 0 || 4 < oo, 0 O ,4 < 
oo. Let on = (3ie llx for A e R, Pi G R,1 — T < l < T — l,m E N. Define for every 
i — 1,..., n 

OO 

Df = Af - E(Aj <1 |Ji- 1 ), A f = E E (^+*l^)e rfA 

1=0 

m t j1 = E D * ?1 E “j-t- 0 ? 1 * l j =!, ■ ■ ■ , n , 

1=1 1=1 
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and 






where denotes complex conjugate. Then 


setting 


|| AP - EA [ ^ j] - M% j] || 

mzTa || Zi o H4II ZjQ || 4 


< CVm(P) for every i,j 


1 


-T -1 

V m (f3) = maxi-T<i<T-if3i + m |A' — A'-i 

v =-1 


Proof. Note that A^ = ^^ 0 E(Z i t +i |J r ;)e* tA and that D-p is a m-dependent martingale 
difference sequence. Then, setting u\^ = |J-/_i), by summation by parts: 


t— 8 m 


t— 8 m 


^ oti-t{Zn - Df) ||< Cm || Z i0 ||| maxi | A I + II (A-t ~ A-t-iM' 


z=i 


Z=1 


< CVm(/3)m II Z i0 || 2 


Likewise 

t— 8 m 

|| ^ - Df) ||< CV*{p)m || Z i0 || 2 . 

1=1 

For wj?' 1 = E£i 8m - d\ j] ) then 


II wf 1 1 

|< CVm(f3)m || Zi 0 11 2 1| Z j0 || 2 

yielding 



T 

4m—1 

(■ T—s)/ 4 m 

11 y id? 11 

Ai 

11 E y'AmiliseA, 

t= 1 

S =1 

1=0 

setting A = maxi <it j <n A^l, A^'l 

— 31 

= Vm(f3)m2Ti | Zi 0 | 2 I ZjQ | 2 - Except for replacing 

N 

O 

to 

O 

to 

g. 

tr 

& 

O 

O 

|| 4 , the 

same bound applies to | E^=i(^2t^ — EW]f) || 


and || EL(^i? ] - EWf 1 ) || setting = ~Z it EzA-s^+i A- t e« A (% - if) and 

W# 1 = (Z it - Df) Et; A- t e t(I " t)A £>P' ] . QED 


Lemma 4. (Lemma 2 of Liu and Wu (2010)) Assume || Z t || p < 00 for p > 2 and EZ t = 0. 
T/ien Lemma 2 holds for every Z it , i — 1,..., n. 


Proof. Trivial since each component of Z t satisfies the assumptions of Lemma 2 of Liu and 
Wu (2010). QED 
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Lemma 5. (Proposition 3 of Liu and Wu (2010)) Let Z t be m-dependent with EZ t = 
0, \Z it \ < M a.s., m < T and M > 1. Let S^f = ^it Yl2\ a T,t- s Z JS , where 

/ > 0,/ + r < T and assume maxi< t <T\o-T,t\ < Kq, , maxi<t<T'maxi<i< 71 EZf t < K 0 for some 
K 0 > 0. Then for any x, y > 1 and Q > 0, 


Q 


Pflsjj 1 - ESg' ] | > x) < 2e _2//4 + CiT 3 M 2 ( x~ 2 y 2 m 3 {M 2 + r) 22 a 

C 2 x 




s=l 


-\-CiT i M 2 maxi <i<n P I \Z it \ > 


ym 2 (M + rW 


for every i,j = 1 ,n. 


Proof. Trivial since each component of T t satisfies the assumptions of Proposition 3 of Liu 
and Wu (2010). QED 


Lemma 6. (Theorem 6 of Liu and Wu (2010)) Let ax,i = bT,ie dX , where A G R,bx,i G R 
with br.i = bx-i and 


T T 


l t ] = 22 a T,i-i' ZiiZjti and a% = u>(\) 22 22 b 2 Tt _ r . 

1 <hl'<T 


r =1 t= 1 


where u(u) = 2 if u/n G Z and u>(u) = 1 otherwise. Assume EZ< = 0, || Z 0 || 4 < oo, ©o ,4 < 
oo and 


Then for 0 < \ < 2n 


~ °(C t)i Ct _ 22 ^T,ti 


0 <t<T 

TCt = 0((Tt), 


t =1 


T r—1 

EE 

r=l t= 1 
T 


T 

E 

\=\-\-r 


Q j T,i — lO'Tft—l 


= o[a- 


T) i 


22 l^ T ’ r — br,r- 1| 2 — °(Ct)- 


r =1 


(L [ f j] - E L [ f j] ) 
ax 


N(0, Att 2 fu(X)fjj(X)). 
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Proof. Note that 


L l f j] = A™ + A [ f j] + or,o E Z * Z 3* 


t =1 


where by Lemma 1 

T 


Y t Z it Z jt -T'y ij { 0) ||< CT*(|| Zj 0 || 4 0^+ II Z j0 || 4 ©g 4 ), 


t=i 


7,j(0) denoting the (ij) entry of T(0). It suffices to show that for any m 


Mp ] + Mp ] 

Ct 


—> d N(0, N(0, Att 2 fii(X) fjj(X)), 


and then use Bernstein’s lemma, where 


1 in 

fu( A) = ^ E e " E ( z ioZa). 

l=—m 


Since || Y%=i Dfu}? ] * ||< CT* maxi< t < T \b Tyt \ : setting U [ t l] * = Yi=lt- 4 m+i)vi a T,i-tD\ ,] , we 
need to show that 

— E (dM ] ° + AW) 

° T i,l+4m 

setting Ul l]< ' = Ya^T a T ,i-tD\\ Since Yt=i+ 4 m II d\ ] u\ 3]<> || 4 < CT(f = o(af) the Linde- 
berg condition conditions applies and Hall and Heyde (1980) holds if 

4 E E (l Dfu?° + Dfufr PlJS-i) -» P 4 5 r 2 /„(A)/ if (A). (12) 

^ t=l+ 4 m 

Rewriting E(-|J 7 t _ 1 ) = YT=i ( E ('l Ft-r) ~ E(-|J r j_ r _ 1 )) + E(-|J 7 t _ m _ 1 ), note that for -m < 
r < m — 1, 

|| ^ (E[|,DfC/p' ]o + Z^p' ] c7i i]<> | 2 |^- t _ r .] - + Z^p' ] t7 t [i]<> | 2 |^- t _ r ._ 1 ]) || 2 

t=l-\-Am 

<4 E II D ? O uF° ||}< CT(‘ = o(<4). 

t=l+4m 
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Since the are measurable whilst the Up are J r t_ 4 rn -measurable, E((£)|^) 2 (C/^ <> ) 2 | Ft-mp 

(t/j J ] 0 ) 2 E((D| ? l) 2 ) and (1T2li is equivalent to 


— (UrU\ j] ^(DfDf) + Uru\ j] ^(DfD [ i ] ) 

O rp \ 

t=l-\-4m 

+|C/“TE(|fl| il | 2 ) + |C/p| 2 E(|flM| 2 )) „ l|Di‘ , l| 2 ||Bp 1 H 2 , 

since ||d|' , || 2 = 2ir/ if (A). Since || Yl.i+im( u t , °ul’ ] °) - E (ul'^U^")) ||= o p (cr|.) and 


X)t=i+ 4 m \ E ( u t ] ° u ? ]<> )\ = o(af), the result follows noticing that 


t—Am 

[®]o 12 ^ _ lA II nj ! l ||2 


E(vn 2 ) = E b h~t ii D 

1=1 


QED 

Set 


and 


gP( A) = lP - E L [ p - Y (Z ^ - EZ itZ Jt ), 


■ fol 


t =i 


9t. 


M 


(A) = IP - E IP - Y&tZjt - E Z it Z jt ), 


: fol 


t =i 


noticing that unless i = j then gp\ A) 7 ^ < 7 ^ (A) = < 7 ^(—A). Set 

tt — p T B t j log 13. 

Lemma 7. (Lemma 3 and Remark 7 of Liu and Wu (2010)) Let Assumptions 1 and 
2 hold and EZ 0 = 0, || Z 0 || p < 00 , p > 4 hold. Further assume S SiP = 0(p s ) for some 
0 < p < 1. Then for any 0 < C < 1, there exists 7 G (0,C) such that, for m = [T 7 ], for 
every — 


max |c/r (A z *) - sfjUA*)| = o p (v / TB T /logB r ), 

Proof. This follows precisely Liu and Wu (2010), by setting 

t -1 

y£ ] (A) = ^^a T ,,_ s Z is . 


S=1 
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and Y t ^}(\) accordingly, where si = [ p ‘ ], 1 < 1 < r, r 6 N such that 0 < p r < C. Also, we 
replace their definition of u r ( A) with 

«r(A) = y . (( y ™w - y M,U A ))+(d?,'(-A) - . 

t&H r 

QED 

Remark. Lemma 4,5,6 of Liu and Wu (2010) extend without any additional difficulty. 

Lemma 8. (Lemma 7 of Liu and Wu (2010)) Suppose EZ 0 = 0, || Z 0 || 4 < oo and 4 = 
0((logT)~ 2 ). For every i, j — 1,..., n we have 

(i) 

|E[#(A0 - E^ 1 (A 1 )][# 1 (A 2 ) - E# ] (A 2 )]| = 0{TBt/ (log Bt) 2 ) 

uniformly on {(Ai, A 2 ) : 0 < A; < n — Bf}( log B T ) 2 , l = 1,2 and |Ai — A 2 | > B T (logB T ) 2 }. 

(ii) 

|%? ] (Ai) - Eg l f j] (X 1 )][g [ f j] (X 2 ) - E#(A 2 )]| = 0(a T TB T nU(X 1 )f jj (X 2 )), 


uniformly on {(Ai, A 2 ) : R^^log B T ) 2 < Xi < tt — Bf 1 (log B T ) 2 , l = 1,2 and |Ai — A 2 
Bf 1 } f or a T satisfying lim sup^^ o>t < 1. 

(in) 


%| j 1 (A) - E^' ] (A )| 2 - An 2 TB T fi i (X)fj j (X) 
uniformly on {B^flog B T ) 2 < A < 7 r — Bf 1 (log B T ) 2 }. 


0(TB T (log B t )~ 2 ), 


> 


Proof, (i) and (ii). Since || A) — iV^(A) ||= 0(y/nm), where 

T t—l—m 

a) = E b A E a T,‘-‘ D ‘.I 

t =1 1=1 


and Mj?\ A) = Mjp\ D^\ = d\^ as defined in Lemma [3J, we need to show that 


r TMM 


E(A^| i] (Ai) + !V| jl (A 1 ))(lv| j] (A 2 ) + lv| j] (A 2 )) 


0 (TR r (lo gj B T )- 2 ), 


since 


E(M [ ; j] (X 1 ) + M [ ; j] (X 1 ))(M [ ^ j] (X 2 ) + Mp ] ( A 2 )) 


< r T,\!,\2 +0(T a / mB T + VfmB T ). 
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Easy calculations yield 


r TMM ~ 

T t—m—1 

E( D® t D® 2 )E(D^ ^t,\2 >E E K\(t - l)/B T )cos{(t - /)(Ai - A 2 )) 

t= 1 Z=1 

T t—m—1 

+E(S!:L-DgjE(Dg i )E E /i 2 ((t-0/ J B T )co S ((t-0(Ai + A 2 )). 

t=i z=i 

Then follows the proof of Liu and Wu (2010). 

(iii) From (i) 


He 

r T,A,A = 

T t—m—1 

E(idh 2 ) E (idii 2 )E E K 2 ((t-i)/B T ) 

t= 1 Z=1 

T t—m—1 

+|E(«)I 2 E E iL 2 ((t-/)/5 T )cos((t-/)(2A)) 

t =i z=i 

Bt 

= 0(TB T (logB T )- 2 )+ II Dj' A || 2 || II 2 T E A- 2 ( S /Bt) 

— Bj' 

= 0{TB T {\ogB T )- 2 ) + 47T 2 K/ ri (A)/^(A), 


where recall that E|L>q A | 2 = 27ifa(\). QED 


Lemma 9. (Lemma 8 of Liu and Wu (2010)) Set E T = B T — (log B T ) 2 . Under the 
conditions of Theorem® for every i, j — 1,..., n 


V 


( 


max 


EEi“! W)l : 


Ulog B T )*<r<E T ^KTBrfu^fjjiXr) 


- 2 log(i? T ) + log(7T log B t ) < X -)■ 


- p ~ x / 2 


with 


*|«(A) = „!«(A)/{|«!‘ 2l (A)| < 'JtBtI (log B t ) 4 }-E («! ,j1 (A)/{|„F 21 (A)| < y/m/OogBr)*}) ,0. 


and 


u 


[him _ 


, (A) = E(^' 

t&Hi 


(A) - EY'«!(A)) 






(-A)), 
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with 


Hi = [(l-l)(p T +q T )+l,p T +(l-l)q T \, Pt = [B^ +l3 ] some small /3 > 0, q T = B T +m,k T = T/(p T +q T ), 
and 

S= 1 

Zfla = Z\ L' - EZft,', 41 ' = 4141411 < (TB T y), a < 1/4. 

Proof. This follows the proof of Lemma 8 in Liu and Wu (2010). QED 

Lemma 10. Let Assumptions 1 and 2 hold. Assume EZ 0 = 0, \\Z\\ p < oo ,p > 4 and 

£>m )P < ^4p m for some 0 < p < 1, A > 0. (13) 

Then for every 1 < i, j < n and every 0 < v < p/2, setting 

Qj- = (TBx log Bji) 5 , 

one obtains, for a constant C^ Pt b, P that depends only on v,p,b,p, 

\\maxo<\<T r T\fTij(\) — E[fTij(X)]\\\ u < C v ^ p ^, p Qt- 

Proof. Set Qij(X) = T\f Ti j(X ) — E[f Ti j( A)]| for simplicity. Obviously (TT3l) implies 
O< Am~ a for any sufficiently large a > 0. Therefore we can assume without loss of 
generality that a satisfies 


b < ap /2 and (1 — 2 a)b < 1 — A/p. (14) 

In fact, set a = max(5], Bf) + 1 where Bi = 2 b/p, B 2 = 1 — (1 — A/p)/(2b). In turn, (fT4l) 
implies that there exists a (3 G (0,1) such that 

b < afdp /2 and (p/4 — aj3p/2)b < p/A — 1. (15) 

In fact, /3 can be obtained as /3 = max(£>i, Bf)ja + 1/2 where B\/a = 2b/(pa), B 2 /a = 
1/a — (1 — A/p)/(2ba). Therefore a and (3 only depend on p, b. 

We then follow the arguments of Theorem 10 in Xiao and Wu (2012) where, in particu¬ 
lar, their Lemma 9 is replaced by our Lemma 2 (see Remark S.2 in Xiao and Wu (2012b)) 
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and their Lemma 11 and 12 are generalized using our Lemmas 2, 5 and Corollary 1.6 and 
1.7 of Nagaev (1979). It remains to show that their result (41) is replaced by 


|| ^ p C S ,t(ZitZj s 'Yijit s)) ||p/2^ 

t,S= 1 

c p/2 v T (y 2 oc p Vre® p e%l + 2 1 - 2 *(eS’,||^„|| P + e^\\z i0 \\„: 

< C r/2 V T (V2dC p VTA 2 /(l - pf + 2 2 ~ 2 ^CpA/{\ - f,)'y (16) 

where 7 ij(u) denotes the (r/')th entry of T(n) and 

T T 

T>r = maxi max > cj ,, max > c\ d . 

y \<s<T ^ s,t kkt-^ ) J 
t= 1 S— 1 

Inequality ([IB]) is a consequence of Lemma 1 and Lemma 2, as follows. First, notice that 
one can rewrite 

T T t -1 

^ ' c-s,t(ZitZj S s)) ^ ^ ^ p c s j(ZitZj S 'Yijij' s)) (17) 


t=i 


t =2 S—1 
T s-1 


££<=». t(ZifZj S 'Yijit ®)) “I - ^ ^ 7./; (ZiiZji 7q(0)) 

s=2 t=l t=l 

(18) 

T 

A\t + ^2r + Ct,t(ZitZj t — 7ij(0)). 


t=i 


We deal with the right hand side of (fT71h namely A the other two terms following along 
the same lines. For simplicity set Ej t -1 = c s,tZj S and Dt = (max\< s <T Y^t=i c st)^- 
Then, for ?,(■) = £(-|.F,) - £(-|.F;-i), 


ViA™ || P <h + Ih, 


setting 

T 

h =|| Zg t {i} [(Ejt- 1 — ifjt-i^/})] ||p, 
t=2 
T 

77; ^ " || (^it Z it: {iy)Ej t _i ||p . 

t =2 
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Since || Ej t || 2p < C2 P Dt@o^p by Lemma 1 noticing that 2 p > 2, and || Z it — Z it ^j || 2p < 

<&, 2p with Yl=2 4i,2 P < ©EL 


T -1 


X nf < cf r D 2 T (eg !*) 2 X egUX'f-,*,) £ c| r B|T(eM 2 l ,) 2 (e 0 B 


hi N2 

2pJ • 


l=—oo 

Similarly, since 


T—l 


l=—o o Z'=l 


T 


T—l 


t =1 


then 


ti's.W lip— 

s=l+£ t=l 


T—l 


^,{d] c -s,t-^j.s,{j} ||p< 2 ^ ^|li, 2 p^2p-PrQo]a P ) 


E < 4C 2 2 p ^(0 o W 2p ) 2 ^ e% p J2^-t,2 P <^ClD 2 T T(Q^ 2p )\Q^ t 2 


0,2p/ ' 


l=—oo 


t=—oo S=1 


Finally, the result follows by using || || 2 < C 2 YllL-oo II lip- The same bound 

applies to || || 2 where now D T must be replaced by (maxi< t <T Tj=i c s,t)^- The third 

term follows by a straight application of Lemma 1. Hence (1T61) is now established. 

For any K > 1, there exists constants C Pi K,p, Ck ,/3 and C p , such that, for all x > 9t, 
we have 


Pr(\Q ij (X)\ >x)< 

c p .K,f,x--i\ellegr/ 2 (LT log t) + c K Ax- rn A§At) r " H T) K + 


(19) 

e -C p x 2 /(TB T ( 0^e^4) 2 ) ; 


setting 

L t = (TB T )$T~ afi $ + TB |' 1_a/3f + T, 
H t = t 1+ ^-^b*. 


Specifically, the second and the third terms in the right hand side of (fT9j) correspond to 
the last two terms in inequality (44) in Xiao and Wu (2012) whereas the first term refers 
to the combination of theirs (50) and (51). Hence (fl9l) follows from the generalization of 
inequalities (43), (44), (45) in Xiao and Wu (2012). 

We shall now use the large deviation inequality (1T9]l and conclude the proof by using 
EX “ = (1/a) x a 1 Pr(X > x)dx which holds for any positive random variable X with 
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finite ath moment. By Theorem 7.28 in Zygmund (2002), let Q* ] = max 0 <A< 7 r |Qjj(A)| and 
A i = ttI/(2B), then Q*j < 2max 0 </<2s \Qij(Xi)\ since Qij(X) is a trigonometric polynomial 
with order B. Hence by (|T9l) . for a sufficiently large constant K > 0, 


x v Pr(Q*j > 2 x)dx < (1 + 2 B T ) / x v 1 max Pr(\Qij (A)| > x)dx 


( 20 ) 


' K0 t 


'K8 t 


< c p> kM 1 + ^B T ){6 v - p/ \Qf p Qfj' 2 L T \ogT + ((^] p Q [ ^) p / 2 K- p / 2 H T ) K 9^ pK/2 + 6^B T Cp '" K2,[e ^ )2 ) 


Elementary calculations show that, under (fT5]h the right hand side of (1201) is 0(9 j.) if 
we choose a large enough K. Hence we have ||Q*j||i/ = 0(9t ) since J^ 9t x u l Pr(Q*j > 
2 x)dx < (K6 tY fv. In particular the two inequalities in (fT5l) allow to bound the terms 
associated with the first and the second component of L The last term of L? does not 
require any restrictions since p/4 > 1. The term involving Ht requires K large enough 
such that 


Ai — 


<K, 


( 21 ) 


(p/4 - 1)(1 - V?) 

and the third, last, term on the right hand side of ()20l) requires K large enough such that 


(0M obi 

l w 0,4 w 0,4 


a 


p,u 


< K. 


( 22 ) 


Since 0^ = S^ p < A/( 1 — p) for every i — 1,..., n, it follows that (1221) is implied by 

A 2 

H 2 = —-< K. 

Cp,v( 1 — p) 2 

Then set K = max(Ai, A 2 ) + 1. This implies that K only depends on z/, p, 6, p. Since the 
same applies to a and /3, it follows that we can construct a constant C U)P) b, P that satisfies 
our statement. QED 


Remark. Lemma 10 can be extended to the case when Sm.p = 0(m ai ), for some cq > 0, 
by suitable modification of ([IT]) . (ITS]) . (1211) and (122|) . 
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